METHOD OF CLOCK MISMATCH AND DRIFT COMPENSATION 
FOR PACKET NETWORKS 

Field of the Invention . 

The present invention , generally, relates to video data 
5 communication systems through packet networks and f more 

particularly, to transmitting MPEG- 2 transport stream data or SDI 
uncompressed video stream data through an IP network. 

BACKGROUND OF THE INVENTION 

With the convergence among television, computer and 
10 telecommunications industries, more and more content are being sent 
through IP networks. Traditionally, a digital television (TV) 
signal is sent over a synchronous network such as DVB-ASI over 
cable or satellite links. The receiver can synchronize easily to 
the input clock that is carried with the signal. 

15 In the applications, such as video-over-IP or video-over-ATM, 

the video is packetized into IP packet or ATM cells and, then, sent 
to the receiver through an asynchronous packet network. Due to the 
network jitter, it is impossible to recover the clock directly from 
the received packets. 

20 In such systems, the receiver typically contains a FIFO memory 

buffer to facilitate a constant or nearly constant output bit rate 
with a variable input bit rate. However, the transmitter /receiver 
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clock mismatch and long term drift will eventually result in the 
under flow or overflow of the receiver FIFO buffer memory. A 
variety of methods have been used to synchronize packet network 
transmitters and receivers. 



5 Description of the Prior Art . 

U. S. patent No. 5,412,642 to Nunokawa granted May 2, 1995 
describes a method that calculates a fluctuation absorbing time- 
base that is based on the decoding time of a heading cell. 



U. S. patent No. 5,640,388 to Woodhead et al. granted June 17, 
10 1997 describes a method and apparatus that stores the data in a 

buffer and outputs the data from the buffer at a rate controlled by 
analyzing time-stamps within the data. 

U. S. patent No. 5,708,656 to Noneman et al. granted Jan 13, 
1998 describes a method and apparatus that selects one of the three 
15 data transmission rates based on the state of two activity timers. 



U. S. patent No. 5,832,256 to 
describes an apparatus that varies 
time clock based on a decoded time 



Kim granted Nov. 3, 1998 

the system clock and the system 

data and a system clock value. 



While these prior patents, at first appearance, have 
20 similarities with the present invention, they differ in material 
respects. These differences, which will be described in more 
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detail presently , are important for the effective use of the 
invention to achieve its advantages. As an example , these prior 
art methods do not modify the receiver clock rate based on the 
amount of data stored in the receiver FIFO buffer memory. The 
5 present invention maintains synchronization without the need to 
analyze or modify the contents of the data stream. 



OBJECTS AND SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a method 
for synchronizing the packet network transmitter and receiver 
10 clocks. 



Briefly , the method of the present invention accomplishes the 
synchronization of the transmitter and receiver clocks of a packet 
network by computing the nominal bit rate through a process that 
includes monitoring the program clock reference, monitoring the 
15 average receiver FIFO buffer memory level and slowly modifying the 
receiver bit rate or receiver clock so that the receiver bit 
rate/clock can match that of transmitter. 



This is accomplished while keeping the resulting ASI/SDI 
signal compliant with the MPEG-2 system specification (ISO/IEC 
20 13818 -n). The method of the present invention can be applied to 
DVB-ASI, ATSC, as well as SDI. In the last case, only the clock 
can be modified, as the bit rate is fixed at 270Mbit/sec. 
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The above and other objects, features and advantages of the 
present invention will become more readily apparent as the detailed 
description of the presently preferred embodiment proceeds. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 Figure 1 illustrates the receiver FIFO buffer memory and data 

being input to it and output from it. 

Figure 2 is a flow chart of the clock mismatch/drift 
compensation algorithm. 

Figure 3 illustrates a receiver FIFO buffer memory level 
10 change vs. time from a low level to a low level nearer the target 
level . 

Figure 4 illustrates a receiver FIFO buffer memory level 
change vs. time from a level below the target level to a level 
above the target level. 

15 Figure 5 illustrates a receiver FIFO buffer memory level 

change vs. time from a low level to a lower level. 

Figure 6 illustrates the receiver FIFO buffer memory size vs. 
time necessary to accommodate network jitter and clock mismatch. 
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DETAILED DESCRIPTION OF THE INVENTION 

Abbreviations and terms . 

There are abbreviations and terms used in this description 
that are defined as follows: 

5 ASI = asynchronous serial interface; 

ATM = asynchronous transfer mode; 
ATSC = advanced television systems committee; 
Bit rate = the rate at which bits are transferred; 
Buffer = a group of data; 
10 DVB = digital video broadcast; 

FIFO = first in first out; 
IP « internet protocol; 

MPEG = motion picture expert group; and 
SDI = serial digital interface, 

15 

Other terms used herein are defined in the MPEG-2 specification 
(ISO/IEC13818-n) and are familiar to those skilled in this art. 

A method according to the present invention monitors the 
receiver FIFO buffer memory level and changes the bit rate or clock 
20 rate of the receiver accordingly to synchronize it with the clock 
rate or bit rate at the transmitter , thus preventing receiver FIFO 
buffer memory underflow and overflow. 
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Referring now to Figure 1 of the drawings , an illustration of 
a receiver FIFO buffer memory is shown having a data pipe with two 
terminals: input and output. At the input terminal , packet data 
coming from a network are injected in small buffers {iBufferSize) , 
5 typically around 1500 bytes. 

At the output terminal, data are pulled out in large buffers 
(mBufferSize) , typically from 64 kilobytes (KB) to several hundred 
kilobytes. These buffers are called MPEG buffers. 

Due to network jitter , the packet data from the network enters 
10 the receiver FIFO buffer memory at variable intervals. The MPEG 
data are removed from the receiver FIFO buffer memory at precise 
intervals. The receiver clock rate and bit rate determines the 
interval at which MPEG data are pulled out from the receiver FIFO 
buffer memory. 

15 This interval changes slightly due to long-term clock drift of 

the receiver clock relative to the transmitter clock. The above two 
factors make the receiver FIFO buffer memory level vary over time, 
but the long term average of the receiver FIFO buffer memory level 
reflects correctly in which way the receiver clock is drifting 

20 relative to the transmitter clock. 

The flow chart illustrated in Figure 2 shows a compensation 
algorithm that illustrates the method of the present invention. The 
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following paragraphs describe the compensation algorithm in detail. 

Initialize the System . 

The first step of the algorithm initializes certain variables 
used in the algorithm. The system is initialized by first 
5 transferring data from the transmitter to the receiver and storing 
that data in the receiver FIFO buffer memory. 

The receiver FIFO buffer memory is filled exactly to the half 
full level before output from the receiver FIFO buffer memory is 
started. The half-full level of the receiver FIFO buffer memory is 
10 half way between underflow and overflow, and hence the optimum 

level of the receiver FIFO buffer memory. This invention attempts 
to maintain the buffer at approximately half full during subsequent 
operation. 

Upon initialization f the following values are assigned: 
15 m = 0 

aveFifoLevelPrevious = aveFifoLevelCurrent = FifoLevel 
where 

in is an integer counter that counts the number of MPEG buffers 
removed from the receiver FIFO buffer memory; 
20 aveFifoLevelPrevious is the average receiver FIFO buffer 

memory level after the previous mBufferSize bytes of data are 
removed from the receiver FIFO buffer memory; 



7 



Atty Docket 10,896 



aveFifoLevelCurrent is the average receiver FIFO buffer memory 
level after the current mBufferSize bytes of data are removed from 
the receiver FIFO buffer memory; and 

FifoLevel is the current receiver FIFO buffer memory level. 

5 Initially, the buffer was loaded to be half full # which is the 
predetermined TargetLevel . 

Compute average receiver FIFO buffer memory level . 

A running average instead of instantaneous receiver FIFO 
buffer memory level is used in order to reduce the effects of 
10 network jitter on the receiver FIFO buffer memory level 
measurement. 



Upon the removal of each MPEG buffer size (mBufferSize) of 
data, according to FifoLevel = FifoLevel - mBufferSize, compute 
recursively the average receiver FIFO buffer memory level. 



15 If (jn < Constl) jn++ 

AveFifoLevelCurrent = (m*aveFifoLevelPrevious + FifoLevel) I (m+1) 
where 

Constl is a constant integer value. In this instance, Constl 
is determined empirically as 100. 



20 



Decide whether, and how much, to change bit rate . 

MPEG-2 system specification ( ISO/IEC13818-n) mandates that the 
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value of the system clock frequency measured in Hz meet the 
following constraints: 

27000000-810 < system_clock__frequency < 27000000+810 

where 

5 system_clock_frequency is the clock frequency of the system; 

and 5 is "less than or equal to". 

The MPEG-2 system specification dictates that the rate of 
change of system clock frequency meets the following constaint: 
Rate of change of system_clock_frequency s clockAdjustmentRate 
10 where 

clockAdjustmentRate is the maximum clock adjustment rate that 
complies with MPEG-2 system specification (ISO/IECl3818-n) ; and 

£ is "less than or equal to". 

clockAdjustmentRate = 0.075Hz/sec 

15 In order to meet the clock range constraint , the maximum 

change of the system_clock_frequency should be bounded. 

deltaRateMax = clockBound*mRate/clockRate . 
deltaRateMax = 810*;nRate/27000000. 
where 

20 deltaRateMax is the maximum rate of change of the 

sys t em_cl ock_£requ en cy ; 

cloc/cjRate is the nominal clock rate of the MPEG-2 transport 
stream, clockRate = 27,000,000 Hz; 
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clockBound is the maximum allowed clock drift according to 
MPEG-2 system specification ( ISO/IECl3818-n) , clockBound = 810; and 

mRate is the bit rate of the MPEG-2 transport stream at the 
transmitter. 

The crystal of the system clock on each transmitter and 
receiver has to meet the following constraints in order for the 
receiver to be able to lock to the transmitter clock: 

27,000,000 - 405 < system_clock_frequency < 27,000,000 + 405. 

To decide whether bit rate change is needed, current and 
previous average receiver FIFO buffer memory levels are monitored. 
The bit rate change on the receiver has the goal to match the 
receiver FIFO buffer memory level target of half full. There are 
three cases as illustrated in Figures 3, 4, and 5 of the drawings. 

Figure 3 shows the case where the current average receiver 
FIFO buffer memory level is closer to the target level than the 
previous average receiver FIFO buffer memory level. The change 
shows a good trend so the bit rate change is set to the minimum and 
the current bit rate is not changed. 

If \(aveFifoLevelCurrent - TargetLevel ) \ < 
J (aveFifoLevelPrevious - TargetLevel ) J then the BitRateChange = 
MinBitRateChange . 
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Figure 4 shows the case where the previous average receiver 
FIFO buffer memory level and current average receiver FIFO buffer 
memory level occur on different sides of the Target level. In this 
case, the bit rate change direction is reversed, and the bit rate 
5 change is set to the minimum. 

If aveFifoLevelCurrent > TargetLevel > aveFifoLevelPrevious or 
if aveFifoLevelCurrent <TargetLevel < aveFifoLevelPrevious then 
BitRateChangeDir = -BitRateChangeDir , and BitRateChange = 
MinBitRateChange 

10 Figure 5 shows the current average receiver FIFO buffer memory 

level is further away from the Target level than previous average 
receiver FIFO buffer memory level. In this case, the bit rate 
change is doubled and the direction is unchanged. 

If {(aveFifoLevelCurrent - TargetLevel) | > 
15 | {aveFifoLevelPrevious - TargetLevel ) \ then BitRateChange = 2 * 
BitRateChange . 

Change bit rate slowly according to MPEG- 2 specification . 

In order to meet the MPEG-2 clock rate change constraint, the 
receiver bit rate can be changed 1 bit /sec up or down every N MPEG 
20 buffers. 
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Once the amount of bit rate change is decided, the receiver 
will change its bit rate by 1 bit/sec every N MPEG buffers until 
the needed change is done. IsBitRateChange is a flag indicating a 
5 bit rate change is needed. 

When a change is needed, this flag is set to TRUE. 
Thereafter, the change is made every N MPEG buffers until the 
change is complete, then IsBitRateChange is set to false. 

Between the moment bit rate change started until the moment 
10 the required bit rate change is applied, no new bit rate change is 
computed, but average FIFO level is still calculated and logged. 

By using the algorithm described, the packet network 
transmitter and receiver clocks are synchronized while keeping the 
resulting ASI/SDI signal compliant with the MPEG-2 system 
15 specification ( ISO/IEC13818-n) . 

In particular, the above algorithm can be applied easily to 
system clock rate change instead of bit rate change. 

The above algorithm can be implemented in host software, 
embedded software or in hardware, as long as the hardware supports 
20 instantaneous and continuous bit rate change or clock rate change. 
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The buffer check interval can be increased significantly once 
the receiver clock is locked to the transmitter clock. The initial 
change can be considered as compensating for clock mismatch, and 
long-term change can be considered as compensating for clock drift. 

5 A sample software program for clock mismatch/drift 

compensation is provided in Appendix A. 

Various performance parameters relative to the method of the 
present invention and the minimum size of the receiver FIFO buffer 
memory required can be calculated as shown in Appendix B. 
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A ppendix A 

Sample Program for Clock Mismatch/Drift Compensation 
/***** start clock drift compensation ************/ 

int Err, FifoLevel; 
5 Bool IsFirstTime, IsRateChanging; 
int n, N; 

Err = GetFifoLevel(&FifoLevel) ; 

if (IsFirstTime) { 

aveFifoLevelPrevious = FifoLevel; 
10 aveFif oLevel = FifoLevel; 

CurrentBit rate - mRate; 
IsFirstTime = 0; 

} 

aveFif oLevel = (aveFif oLevel*m + FifoLevel )/ (m+1 ) ; 
15 if(m<100) 
m++; 

n++; 

if(n%N == 0 && ( 1 IsRateChanging ) ) {//test only when we finished 
current bit rate change 
20 aveFif oLevelCurrent = aveFif oLevel; 
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if ( ( (Target>aveFifoLevelPrevious)&&( Target >aveFif oLevelCurrent ) ) | | ( 
(Target<aveFifoLevelPrevious) && (Target<aveFif oLevelCurrent ) ) ) { 

//previous and current fifo levels are on the same side of the 
Target 

5 if ( abs ( Target-aveFif oLevelPrevious ) <abs ( Target- 

aveFif oLevelCurrent) ) { 

//we are still lagging behind , increase delta to catch 

up 

delta = delta * 2; 
10 IsRateChange = 1; 

if (delta > DeltaRateMax) 

delta - DeltaRateMax; 

} 

else { 

15 //we are in the correct trend, remember 

the delta and do not change the bit rate 

IsRateChange = 0; 

//reduce delta to minimum 
delta = 1; 

20 } 



} 

else { 

IsRateChange = 1; 
//set delta to minimum 
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delta = 1; 



if ( I sRateChange ) { 

if (Target > aveFif oLevelCurrent ) { 
5 //slow down clock 

deltal = -delta; 

if (CurrentBit rate + deltal - mRate < - 

DeltaRateMax) { 

deltal = mRate -CurrentBit rate - 

10 DeltaRateMax; 

> 

> 

else if (Target < aveFif oLevelCurrent ) { 
//speed up clock 
15 deltal = delta; 

if (CurrentBit rate + deltal - mRate > DeltaRateMax) 

{ 

deltal = mRate -CurrentBit rate + 

DeltaRateMax; 
20 } 
} 

Is Rat eC hanging = 1; 
if (deltal »- 0) { 
delta = 1; 

25 } 
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else { 

delta ■ abs(deltal); 

> 

}//end if (IsRateChange) 
5 aveFifoLevelPrevious = aveFif oLevelCurrent ; 
}//end if (n%N==0) 



//change the bit rate gradually now 
if((n%N==0) && IsRateChanging) { 
if(deltal >0) { 
10 //increase bit rate by lbit/sec 

CurrentBit rate - mpTransportSetBit rate(m_transport, 1, 
BIT RATE_RELATIVE ) ; 

deltal — ; 

} 

15 else if (deltal <0) { 

//decrease bit rate by lbit/sec 

CurrentBit rate = mpTransportSetBit rate(m_transport, 
-1, BIT RATE_RELATIVE) ; 

deltal++; 

20 } 

else {//deltal = 0 

//finished rate change 
IsRateChanging =0; 

} 
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/*****end clock drift compensation**********/ 
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A ppendix B 

Various performance parameters relative to the method of the 
present invention and the minimum size of the receiver FIFO buffer 
memory required can be calculated as follows: 

5 Theoretical bounds without network jitter . 

In absence of network jitter , the time needed to lock receiver 
to transmitter clock , and the minimum amount of receiver FIFO 
buffer memory required can be computed. 

The bit rate at the receiver will appear as the following bit 
10 rate on the transmitter: 

mRate' = RxClockRate * mRate /TxClockRate 
where 

TxClockRate is the transmitter clock speed; 
RxClockRate and receiver clock speed; and 
15 mRate' is the bit rate at the receiver. 

If 1 bit /sec is changed every N MPEG buffers, it will need 
\mRate' -mRate \*N buffers to lock the receiver bit rate to 
transmitter bit rate. N is the number of MPEG buffer removals 
between adjustment of bit rate. N is computed as follows: 

20 N = nBuffersPerSec/AdjustableBit ratePerSec 

= (jnRate/mBufferSize*8)*( 27000000/ (mRate*0. 075) ) = 
4 5 00 00 00 ZmBufferSize 

where 
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nBuffersPerSec is the number of MPEG buffer removals per 

second. 

nBuffersPerSec = mRate/ (mBufferSize*8) 

adjustableBit ratePerSec is the bit rate adjustment in 
5 units of bits/sec. 

adjustableBit ratePerSec = 

mRate*ClockAdjustmentRate/clockRate=ntRate*0 . 075/27000000 - 

It is important to note that the interval does not depend on 
bit rate. The decision whether bit rate change is needed can be 
10 made every N MPEG buffer removal from the receiver FIFO buffer 
memory . 

The time needed to match the bit rate is: 
AT = [j^ate' -inflate^ 

where 

15 AT is the time, in seconds , needed to match the bit rate, 

mBufferSize is the size of the receiver FIFO buffer 
memory output buffer. 

Between the time the system started to the time the receiver 
is locked to the transmitter, the average bit rate difference is 
20 (jnRate' -inflate |/2. The total buffer drain or fill in this time 
interval is: 

ABuffer = ( |inRate '-mRate 1 12 ) * AT/8 (bytes), 
where 
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ABuffer is the number of bytes of data transferred to or 
from the receiver FIFO buffer memory in the AT time 
interval . 

The minimum size of FIFO to prevent overflow and underflow due 
to clock mismatch will be: 

minFifoSize = 2* ABuffer . 

where 

minFifoSize is the minimum size of FIFO to prevent 
overflow and underflow due to clock mismatch. 

Bounds with network jitter . 

In a real network environment , an even larger receiver FIFO 
buffer memory is needed to accommodate network jitter (Figure 6). 

J = (FifoSize - minFifoSize) *8 / mRate. 
where 

J is the maximum network jitter. 

Rearranging the above equation, the required receiver FIFO 
buffer memory size is computed as follows: 
FifoSize = J*mRate/8 + minFifoSize. 

The invention has been shown, described and illustrated in 
substantial detail with reference to presently preferred forms of 
the invention. It will be understood by those skilled in this art 
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